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(54) Video scaling method and device 

(57) A linear interpolator and decimating FIR filter 
with constant coefficients in various configurations to 
scale a still or moving color video image horizontally or 
vertically. For downscaling, the input pixel stream is ini- 
tially upscaled with an interpolator by an upscaling factor 
of between one and two chosen so that the result can be 



subsequently downscaled with a decimation-by-power- 
of-two finite impulse response (FIR) filter. Upscaling is 
accomplished by means of linear interpolation. Vertical 
and horizontal scaling may be performed with different, 
independent scaling factors. 
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Description 

The present invention relates to video image resizing architectures, and particular to a device and method for scaling 
a still or moving video image comprised of a first plurality of digital picture elements (known as pixels) in order to replicate 
5 the image with a second plurality of pixels. 

A digital video image comprises an array of pixels, with the number of pixels in each horizontal row and vertical 
column being determined by the system in which the image is formed. When the image is to be displayed in a system 
that uses the same number of pixels in each row as the input image and the same number of pixels in each column as 
the input imaga, the image may be displayed directly. However, when the image is to be displayed in a system that uses 
10 a different number of pixels in each row and/or a different number of columns as the input image, the image must be 
scaled so that the same image can be displayed in the new array of pixels. For example, an image comprising a 500 by 
750 array of pixels must be scaled up before it can be displayed in a system that uses an array of 750 by 900 pixels. 
Conversely, the same image may need to be scaled down before it can be displayed in a system using an array of only 
250 by 350 pixels. As is apparent, the horizontal and vertical scaling factors may not be the same, similar scaling steps 
is may be required when a portion of an image on a display is to be enlarged to f ill the entire display or when an image on 
a display is to be reduced and provided as a small inset in the display. 

Digitized color video images are typically comprised of pixels that include data bits for luminance (Y) and for chromi- 
nance (U, V), and may have, for example, eight data bits for each of the Y, U and V components (other color component 
systems, such as Red, Green, Blue (RGB), being equivalent.) When a color image is scaled for display in another system, 
20 each of the color components must be scaled. 

Video images are desirably scaled in real-time (i.e at the rate they are delivered to the video processing system) 
when upscaling (increasing the number of pixels per image) or downscaling (decreasing the number of pixels per image.) 

When an image is to be scaled, an input stream of pixels may be mapped to an output stream by interpolation. For 
example, when an image is to be scaled using linear interpolation, the input stream of pixels may be mapped into incre- 
25 ments dx, where dx=1/K and'K is a scaling factot. As illustrated in Figure 1 , with an upscaling K = 3/2 (dx - 2/3) , an 
input stream of six pixels may be mapped into nine increments that wiil become nine output pixels.- The value of each 
of the nine output pixels may be determined by interpolating between corresponding pixels in the input stream. 

Ah object of the present invention to provide a device and method for scaling a video image, and to provide a device 
and method for real-time upscaling or downscaling a video image, and in which interpolation and subsequent decimation 
30 are performed without skipping pixels, rows or lines to provide a high quality scaled image, and also for real-time upscaling 
or downscaling a video image in which buffer size requirements are reduced and the number of buffers is minimized 
without limiting downscaling capability. 

A further object is to provide a device and method for scaling a video image in which upscaling is accomplished 
with a single pixel or line buffer component and linear interpolator, and downscaling is accomplished with a upscaling 
35 linear interpolator and decimating FIR filter where the number of filter taps (i.e. bandwidth) is related to the decimating 
factor. 

The present invention includes a device for scaling an input of a first plurality. of pixels arrayed in horizontal rows 
and vertical columns that form an image in order to provide an output of a second plurality of pixels that forms the image, 
the device comprising as a set an upscaling interpolator comprising (a) a buffer for storing the input pixels, and (b) a 

40 linear interpolator that sequentially receives each of the stored input pixels from said buffer and the pixel subsequent 
thereto for providing interpolated output pixels therefrom responsive to a predetermined upscaling factor, a decimating 
finite impulse response (FIR) filter for reducing the number of output pixels from said upscaling interpolator responsive 
to a predetermined downscaling factor, said second plurality being equal to said first plurality times said upscaling and 
downscaling factors, and in which repetitive operation of said set of said upscaling interpolator and said decimating FIR 

45 filter will provide an output of the second plurality of pixels that forms the image. 

The invention also includes a method of scaling an input of a first plurality of pixels that form an image to provide 
an output of a second plurality of pixels that forms the image, the method comprising the steps of: 

(a) upscaling the input pixels in an interpolator responsive to an upscaling factor; and 
so (b) decimating the upscaled pixels in decimation-by-power-of-two-FIR filter, the upscaling factor being selected so 
that the subsequent decimation by power of two provides the second plurality of pixels. 

The invention will now be described by way of example, with reference to the accompanying drawings in which 

55 Figure 1 is an illustration of mapping an output image size onto an input stream of pixels that may be used in linear 
interpolation. 

Figure 2 is a block diagram of an embodiment of an interpolator. 

Figure 3 is an illustration of operation of the linear interpolator of Figure 2. 

Figure 4 is a block diagram of an embodiment of a decimating filter. 
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Figure 5 is a block diagram of an embodiment of a scaling device. 

Figure 6 is a bfock diagram of an embodiment of a color video scaling device. 

A device and method for scaling a moving or still video image may include an interpolator for. upscaling and a 
5 decimating filter for downscaling. The upscaling interpolator may use an upscaling factor chosen so that the desire 
scaling of the image may be achieved by subsequent decimation in a dedmation-by-power-of-two finite impulse response 
(FIR) f ilter. These two components may be used in several image scaling arrangements, including color image scaling, 
that will be discussed in detail following separate descriptions of the interpolator and filter. For example, the two com- 
ponents may be used as a set, and two sets may be paired to provide vertical and horizontal scaling in which the vertical 
10 and horizontal scaling factors need not be the same. 

Figure 2 illustrates an upscaling interpolator 20 with a buffer 22 for storing pixels from an input stream of pixels 24, 
and a linear interpolator 26 that sequentially receives each of the stored input pixels from the buffer 22 and the pixel 
subsequent thereto from the input stream 24 for providing an output of interpolated pixels 28 responsive to a predeter- 
mined upscaling factor K. The upscaling interpolator 20 provides an output stream with more pixels per image than the 
is input stream, such as illustrated in Figure 1 . That is, an .input stream of six pixels will become an output stream of nine 
pixels (with K = 3/2). The same structure may be used for horizontal scaling, in which event the buffer is a pixel buffer, 
or for vertical scaling in which event the buffer is a line buffer with its length equal to the number of pixels per line. 

Each input pixel is first stored in the buffer 22 and then provided to the linear interpolator 2S so that it may be 
evaluated with the next pixel. In the linear interpolator 26 the size of the pixels in the output stream is mapped onto the 
20 input stream of pixels by stepping across the input stream in increments dx (such as illustrated in Figure 1). Since this 
isan upscaling interpolator, the increment dx is less than one (i.e., K> 1). The stepping operation may be accomplished 
in an accumulator that adds the number of increments dx across the image (£dx). The fractional part of £dx, designated 
Ax and shown in Figure 1, is the fractional distance between, two input pixels that will be used to find the interpolated 
value for an output pixel therebetween. Mathematically, 

25 

Ax = Ldx Modulo 1 (1) 

The next step is to use Ax and the values of the neighboring pixels to calculate the interpolated value for the 
output pixel. This calculation may be understood with reference to Figure 3 that is an expanded view of a portion of a 
30 stream 30 of input pixels Y1, Y2, Y3, etc. in which input pixel values are indicated by vertical bars 32. The interpolated 
values of the output pixels may be determined using: 

Z1 > Y1 + (Y2 - YT)Ax * (2) 

35 where, Z1 is the interpolated value of the. output pixel between input pixels Y1 and Y2, and is illustrated in Figure 3 by 
the vertical bar 34. 

With reference again to Figure 2, this calculation may be performed in the linear interpolator 26 that receives the 
value of Y1 from buffer 22 and the value of the subsequent pixel Y2 from the input stream 24. The value of Z1 is sent 
in the output stream 28. 

40 As may be seen in Figure 3, there may be situations where more than one interpolation calculation is required for 
a pair of input pixels. For example, two output pixels Z2 ; and Z3 fall between input pixels Y2 and Y3. The value of Z2 
may be calculated as discussed above, and the value of Z3 may be calculated by substituting the value (Ax + dx) for the 
value Ax. In general, for a given set of input pixels, interpolations are generated so long as the accumulation of dx does 
not increment beyond the next integer pixel value. For an upscaling factor of K, the average number of interpolations 

45 per input pixel is K, and the maximum number of interpolations is the integer part of K + 1 , while the minimum number 
of interpolations is the integer part of K. 

The precision required for the fractional part of dx (that is, the number of bits needed to represent dx) is governed 
by the interpixel precision needed and the number of times dx is stepped across the image. For example, if it is known 
that the number of pixels will be no greater than 768 pixels per line, then the worst case output pixel phase jitter is two 

so nanoseconds at 13.5 Mhz (corresponding to 1/37.037 of one inter-pixel time span), and six bits of interpixel precision 
will be required. Further, as dx will be summed over 768 pixels, ten bits of additional precision will be needed for the 
sum. Therefore, dx must have a fractional precision of sixteen bits. In this example, the precision requirement for Ax is 
six bits and Ax may be calculated by rounding the output of the dx accumulator to six bfts. 

Figure 4 shows a decimating filter 40 may receive the output stream 28 of interpolated pixels from the interpolator 

55 20. Filter 40 includes a decimating finite impulse response (FIR) filter 42 and a buffer 44. The output 46 from the deci- 
mating filter 40 is a stream of correctly scaled pixels that form an array of pixels that represents the input image. When 
the filter 40 is being used a vertical filter the buffer 44 may include two line -buffers, and when the filter 40 is being used 
as a horizontal filter the buffer 44 may include a minimum number of pixel buffers, desirably two. 
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The FIR filter 42 decimates the number of input pixels by a decimating factor equal to a predetermined power of 
two. The filter may operate by accumulating filter calculations in buffer 44 for a number of the filter taps and then calcu- 
lating the remainder of the filter and dumping the buffer at the decimated rate. For a decimating factor of D, a FIR filter 
with D + 1 taps may be used. For example, a three tap filter will decimate by 2, a five tap filter will decimate by 4, a nine 
tap filter will decimate by 8, etc. Each of these D + 1 tap filters has only one set of constant coefficients which are 
predetermined and set to achieve the desired bandwidth for that filter. For example, a five tap filter that decimates by 4 
would have one set of coefficients designed to limit the bandwidth to 1/8 the input sampling frequency. The filters are 
desirably symmetric, that is, the five coefficients for a five tap filter would be C0, C1 t C2, CI , C0. 

The operation of the decimating filter 40 may be more clearly seen by reference to three examples, a two-to-one 
decimation, a four-to-one decimation, and an eight-to-one decimation. In two-to-one decimation, the FIR filter 42 has 
three taps which are generated and output for every other interpolated input. Note that the interpolated input may include 
two output pixels between some pairs of input pixels (for example output pixels 22 and 23 in Figure 3) and these two 
output pixels of the interpolator will be referred to as 2a and 2b. The sequence of operation of the filter 42 is shown 
below in the various states. of its operation. The filter is symmetric and includes coefficients C0, C1 , and C0. 
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25 



State 0 
State 1 
State 2 

State 3 

State 4 



Start-up operation; no interpolation. (Input from interpolator 26) 

2a • CO + 2b * CI = buffer input 

2a • CO + buffer output = output 46 

2a • CO + 2b • C1 = buffer input 

2a • CO + buffer output = output 46 

2a * CO = buffer input 

2a * Ct + 2b - CO = output 46 

2b • CO = buffer input 



30 



35 



Note that two multiplications are required for the filter calculations and two for the interpolation for a total of four 
multiplications per input pixel. The coefficients may be set to provide a bandwidth of V£ the input sampling rate. 

In four-to-one decimation, a five tap filter is implemented before output pixels are dumped every fourth clock Coef- 
ficients may be set to provide a bandwidth of 1/8 the input sampling rate, in this example the interpolation pattern repeats 
every three inputs and the output pattern repeats every four interpolations. 
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State 0 
State 1 
State 2 
State 3 
State 4 
States 



Start-up operation; no interpolation (Input from interpolator 26) 

2a ' CO + 2b * CI = buffer input 

2a • C2 + 2b • C1 + buffer output = buffer input 

2a ■ CO + buffer output = output 46 2a'C0 = buffer input " 

2a - C1 + 2b * C2 + buffer output = buffer input 

2a ■ C1 + 2b ■ CO + buffer output ~ output 46 

2b • CO = buffer input 



50 

In eight-to-one decimation, a nine tap filter is implemented before output pixels are dumped every eight output 
samples. Coefficients may be set to provide a bandwidth of 1/16 the input sampling rate. As in the above, a maximum 
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of four multiplications are required per input pixel. 



State 0 



Start-up operation; no interpolation (Input from interpolator 26) 

Za'CO + Zb • C1 =buffer input 

Za ■ C2 + Zb • C3 + buffer output = buffer input 

Za * C4 + buffer output = buffer input 

Za - C3 + Zb - C2 + buffer output = buffer input 



5 



Statel 



State2 



State3 
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State4 



States 



Za • C1 + Zb ■ CO + buffer output = output 46 
Zb * CO = buffer input 
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The interpolator and filter may be used in various configurations depending on the scaling to be performed. The 
components may be used to scale horizontally (changing the number of pixels per row) and to scale vertically (changing 
the number of pixels per column). These operations may be performed independently without regard to which scaling 

20 is performed first and with different horizontal and vertical scaling factors, K h and It may be desirable to perform the 
vertical upscaling first so that the buffers used for vertical upscaling do not have to store the upscaled number of pixels 
in the horizontal rows and may be at minimum length. 

For downscaling, the input pixel stream is initially upscaled by an upscaling factor of between one and two chosen 
so that the result can be subsequently downscaled by a power of two to provide the desired final scaling. For example, 

25 if a final scaling of 5/8 is desired, the input pixels may be initially upscaled by a factor erf 5/4 in the interpolator 20 and 
-thereafter decimated by a factor of 2 (downscaled by 1/2) in the decimating fitter 40. Upscaling is a special case in which 
there is no decimation and in which the upscaling factor is not limited. In this manner, any final scaling factor may be 
achieved with simple linear interpolator and power-of-two FIR filter with constant coefficients. 

Figure 5 illustrates a scaling device with interpolators 20 and filters 40. An input stream of pixels may be scaled 

30 vertically using a first set 48 of interpolator 20 and filter 40, and thereafter scaled horizontally using a second set 50 of 
interpolator 20 and filter 40 that may be same as the first set 48. The only difference between the vertical and horizontal 
scaling is that the vertical scaling uses row delays and stores rows of pixels, while the horizontal scaling uses pixel delays 
and stores a pixel at a time. The sequence of the sets 48 and 50 for horizontal and vertical scaling may be reversed. 
The order of the Fl R filters (the number of taps) can be changed by changing the number of line or pixel buffers and 

35 multipliers. For example, if three, rather than two, line or pixel buffers drive the filter, an N:1 filter would have N + 3 taps 
for scaling factors of from (V& through 1 1)/N, where N is a power of 2. Two additional multiplications would be required 
per input pixel. 

Color video images may be scaled using the interpolator and filter discussed above. With reference to Figure 6^ 
color video input may be separated into Y and UV components and provided to staged interpolators 52 and filters 54, 
40 with the order of vertical and horizontal scaling being dependent on application. The interpolators 52 and filters 54 may 
each include two sections, each section comprising the interpolator 20 and filter 40 discussed above. The Y and UV 
components may share a common scalingfactor at each stage (the vertical and horizontal scaling factors may be inde- 
pendent.) Alternatively three separate and parallel scaling operations (one each for the Y, U, and V bits in the pixels) 
may be used. 

45 The luminance (Y) information in each pixel is desirably scaled as indicated above using all input pixels. Preferably, 
the U and V information is subsampled in alternating pixels to reduce scaling hardwara By sampling the U and V in a 
two-to-one ratio, the scaling hardware may be shared so that two parallel scaling operations (e.g., the device illustrated 
in Figure 6) may be used (one for Y and one alternating between U and V) instead of three. 

The U and V components may be sampled in various formats. For example, a 4:2:2 format horizontally subsampjes 

so U and V two-to-one relative to Y, but does not subsample vertically. A 4:2:0 format subsamples vertically as well. For 
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example, the 4:2:2 sampling format (spatial arrangement of two rows of sampled pixels is shown, the pattern repeats) is: 

YYYYYYY (luminance) ' - 

0 0 0 0 (chrominance, U or V) 
YYYYYYY \ 
0 0 0 0 

That is, the data are clocked in as 

YUV y YUV y YUV y YUV 

15 

and Y,U, and V information is subsampled from every other pixel (shown in capita! letters), and the U and V 
information from the other pixels (shown with a smalf y) is not subsampled. 

The 4:2:0 sampling format (spatial arrangement of four rows of pixels is shown, the pattern repeats) is: 

YYYYY 
00 

YYYYY 

YYYYY . 
0 0 

YYYYY - 

That is, in the 4:2:0 format U and V information is subsampled 2:1 vertically and horizontally, and there is a one- 
half pixel offset of U and V information relative to Y information in both directions. 

35 In the 4:2:2 format, an input stream of pixels may be clocked at a fixed clock rate generated by the video source. 
The input format maybe binary words, for example eight bits long, on each clock, with one word being the Y scaler input 
and the other alternating between U and V. The Y input may be an unsigned eight bit binary number while the U and V 
may be unsigned or signed two's complement eight bit binary number. The A x 4 used in the U and V calculations, denoted 
Auv, may be the same for both U and V because the spatial relationship between Y and U or V is fixed. This means that 

40 Auv may be the same as Ay or determined by dividing by two, where ay is the Ax for Y. 

The process of positioning the U and V outputs relative to the Y outputs may be accomplished in the scaler hardware 
by a combination of adding a phase offset to the U, V interpolation position relative to the Y position, and (or alternatively) 
adjusting the phasing the U,V decimating filter relative to the Y filter at the beginning of the row or array. This adjustment 
may include providing an unfiltered interpolation of the first U,V row or pixel followed by starting the U,V filter at the time 

45 that results in subsequent U, V filter outputs being properly positioned. 

For example, and with reference to Table 1 below that depicts alternative spatial arrangements of the pixels (phase 
adjustment being performed in one dimension at a time using the interpolator and/or filter), consider horizontal rescaling 
a 4:2:2 input to a 4:2:2 output with four-to-one decimation. As may be seen in the middle section of Table 1 , proper output 
positioning occurs when £duv 1/2 Ldy, and the second U, V interpolation is output directly (a point output with no filtering) 

so followed by starting the U,V filter on the seventh Y interpolation (n = 6, where n is the number of consecutive input pixel 
Y interpolations as counted (beginning from 0) from the beginning of the pixel row.) This corresponds to the fourth U,V 
interpolation. Table 1 also includes examples of two-to-6ne deci-mation for 4:2:2 and 4:2:0 output formats, and illustrates 
how this method of scaling can facilitate video format conversions. Similar examples of vertical rescaling are shown in 
Table 2,. 

55. Table 3 summarizes scaling options available jn a device incorporating the present invention that is used as a 
NTSC/PAL decoder/sealer (4:2:2 input) in which downscaling includes 2:1, 4:1 and 8:1 decimations and upscaling is 
1:1.2 (vertical only, horizontal upscaling is not needed in this particular application.) 

A linear interpolator and decimating FIR filter with constant coefficients in various configurations to scale a still or 
moving color video image horizontally or vertically. For downscaling, the input pixel stream is initially upscaled with an 
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interpolator by an upscaling factor of between one and two chosen so that the result can be subsequently downscaled 
with a decimation-by-power-of-two finite impulse response (FIR) filter. Upscaling is accomplished by means of linear 
interpolation. Vertical and horizontal scaling may be performed with different, independent scaling factors. 

TABLE 1 

U/VVS Y PIXEL SITING, HORIZONTAL 
4:2:2 > 4:2:2 HORIZONTAL DOWNSCALE, 2:1 




40 



INTRPOUT 



FILTER I/O o 



4:2:2 INPUT 



INTRPOUT 



FILTER I/O _ 



4:2:2 INPUT 



INTRP OUT 



FILTER I/O 



4:2:2 > 4:2:2 HORIZONTAL DOWNSCALE, 4:1 

Y .. Y, 




4:2:2 > 4:2:0 HORIZONTAL DOWNSCALE, 2:1 

Y. 




45 



LEGEND: 

Y Y PIXEL INPUT/OUTPUT 

0 UORV PIXEL INPUT/OUTPUT 

1 MAPPED INTERPOLATION POINT ( OUTPUT TO INPUT ) 



so 



ss 



FOR THE FILTER I/O 

BOLD ( NOT UNDERLINED ): DECIMATED FILTER OUTPUT OR UNFILTERED INTERPOLATION TO OUTPUT 
BOLD ( UNDERLINED ): UNFILTERED INTERPOLATION TO OUTPUT AND ALSO FIRST FILTER INPUT 
UNDERLINED: FILTER INPUT NOT CORRESPONDING TO AN OUTPUT OR THE FILTER OUTPUT SITING 
ITALIC: FILTER INPUT AND ALSO THE TIME CORRESPONDING TO THE FILTER OUTPUT SITING 
-: UNUSED INTERPOLATION OUTPUT 
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TABLE 2 

U/VVSY PIXEL SITING, VERTICAL 



4:2:2 > 4:2:2 
2:1 DECIMATE 



ar 




YOYO Y 0 
YvO^ Y 0 Y 0 




4:2:2 > 4:2:0 
2:1 DECIMATE 



o ^ 



o 



Y^^^O K 0 



y o ro Y 0 

Y\QXY 0 C O 
Y > ^\ Y 0 Y 0 




4:2:2 > 4:2:0 
4/3 UPSCALE 



o • — 
~> ifJ 
^ S E 



YOYO K 0 



0 



Y 0 Y 0 Y 0 
LEGEND: 

Y Y PIXEL INPUT/OUTPUT 

0 U OR V PIXEL INPUT/OUTPUT 

1 MAPPED INTERPOLATION POINT ( OUTPUT TO INPUT ) 

FOR FILTER I/O: 

BOLD: DECIMATED FILTER OUTPUT OR UNFILTERED INTERPOLATION TO OUTPUT 
UNDERLINED: RLTER INPUT NOT CORRESPONDING TO AN OUTPUT OR THE FILTER OUTPUT SITING 
ITALICS: FILTER INPUT AND ALSO THE LINE CORRESPONDING TO THE FILTER OUTPUT SITING 
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TABLE 3 

NTSC/PAL DECODER/SCALER 
U/V VS Y SCALER OUTPUT FUNCTIONS 
(4:2:2 INPUT VIDEO ASSUMED ) 





OPERATION 


Xduy . 


POINT 
OUTPUT 


STARTER U, V 
FILTER 


u,v 

DECIMATE 


15 


4:2:2 > 4:2.2 












HORIZONTAL 
DOWNSCALE 










20 


2:1 


1/2(Xd v )+1/2(d v ) 
neven 


n = 0 


n = 2 


2:1 




4:1 


1/2 ScL n even 


n = 2 


n = 6 


4-1 


25 


8i 


1/2 Xdy, n even 


n = 4. 


n = 12 


8*1 




VERTICAL 












UPSCALE 


Xd y 


ALL 


NONE 


NONE 


30 


DOWNSCALE 


Sdy 


NONE 


n = 0 


EQUALS Y 




4:2:2 > 4:2:0 










35 


HORIZONTAL 
DOWNSCALE 


1/2 Xdy, neven 


NONE 


n = 0 


EQUALS Y 




VERTICAL 










40 


UPSCALE 


(2d y )+1/2(d y ) 
neven 


n = 0 


n = 1 


2:1 




2:1 


Xdy 


NONE 


n = 0 


4:1 




4:1 


Xdy 


NONE 


n = 0 


8:1 


45 


8:1 


Xdy 


NONE 


n = 0 


16:1 
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Claims 

1 . A device for scaling an input of a first plurality of pixels arrayed in horizontal rows and vertical columns that form an 
image in order to provide an output of a second plurality of pixels that forms the image, the device comprising as a 
55 set an upscaling interpolator comprising (a) a buffer for storing the input pixels, and (b) a linear interpolator that 
sequentially receives each of the stored input pixels from said buffer and the pixel subsequent thereto for providing 
interpolated output pixels therefrom responsive to a predetermined upscaling factor, a decimating finite impulse 
response (FIR) filter for reducing the number of output pixels from said upscaling interpolator responsive to a pre- 
determined downscaling factor, said second plurality being equal to said first plurality times said upscaling and 
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downscaling factors, and in which repetitive operation of said set of said upscaiing interpolator and said decimating 
FIR filter will provide an output of the second plurality of pixels that forms the image. 

2. A device as claimed in claim 1 wherein said set of said set of said upscaiing interpolator and said decimating FIR 
filter is for horizontal scaling, and, a second said set of said upscaiing interpolator and said decimating FIR filter for 
vertical scaling, said two sets being arranged in series so that the output of one said set is the output of the other 
said set 

3. A device as claimed in claim 2 wherein said second set provides its output to the other said set. 

4. A device as claimed in claim 2 wherein said set provides its output to said second set and in which the predetermined 
upscaiing and downscaling factors of said upscaiing interpolator and said decimating FIR filter of said set are inde- 
pendent from the predetermined upscaiing and downscaling factors of said upscaiing interpolator and said deci- 
mating FIR filter of said second set 



15 



A device as claimed in any one of claims 1 to 4 wherein said input pixels comprise luminance data and chrominance 
data, and said device comprises one said set of said upscaiing interpolator and said decimating FIR filter for scaling 
said chrominance data, and a second said set of said upscaiing interpolator and said decimating FIR filter for scaling 
said luminance data, and said input pixels comprise N color data components, and said device comprises N ones 
20 of said set of said upscaiing interpolators and said decimating FIR filters, and said decimating FIR filter decimates 
in powers of two. 

6. A device as claimed in any one of claims 1 to 5 wherein said upscaiing factor is at least one and no greater than 
two, in which said buffer comprises two row buffers. - 



25 



7. A device as claimed in any one of claims 1 to 6, including an interpolator for increasing the number of input pixels 
to a third plurality of interpolated pixels, a decimating-by-power-of-two FIR filter for reducing the. number of interpo- 
lated pixels to said second plurality of output pixels, and each said interpolator is responsive to a scaling factor of 
at least one and no greater than two, said scaling factor for each said interpolator being independent of said scaling 
30 factor for the other said interpolator, in which one said interpolator comprises one row buffer and one said FIR filter 
comprises N taps, with N being one greater than the power of two decimation of said one FIR filter, or preferably 
one said interpolator comprises two row buffers and one said FIR filter comprises N taps, with N being three greater 
than the power of two decimation of said one FIR filter. 

35 8. A device for scaling an input of a first plurality of pixels arrayed in horizontal rows and vertical columns that form an 
image in order to provide an output of a second plurality of pixels that forms the image, each of the pixels having N 
color components, the device comprising, first means for vertically scaling pixels, second means for horizontally 
scaling pixels connected in series with said first means, each of said'f irst and second means comprising plural sets 
of an upscaiing interpolator and a decimating FIR filter connected in series therewith, each of said sets for scaling 

40 at least one of said N color components, in which at least one of said sets is for scaling two of said N color compo- 
nents, and for subsampling said two color components at a rate related to a decimating power of said FIR filter. 

9. A device as claimed in claim 8 wherein said N color components are Y, U and V components, and for subsampling 
said U and V components at a rate related to a decimating power of said FIR filter, and another of said sets is for 

45 scaling said Y components without subsampling. 

1 0. A method of scaling an input of a first plurality of pixels that form an image to provide an output of a second plurality 
of pixels that forms the image, the method comprising the steps of: 

so (a) upscaiing the input pixels in an interpolator responsive to an upscaiing factor; and 

(b) decimating the upscaled pixels in decimation-by-power-of-two-FIR filter, the upscaiing factor being selected 
so that the subsequent decimation by power of two provides the second plurality of pixels. 

11. A method as claimed in claim 10 wherein steps (a) - (b) are for vertically scaling responsive to a vertical scaling 
factor, and further comprising the step of horizontally scaling the vertically scaled image responsive to a horizontal 
scaling factor by repeating steps (a) - (b). . 
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